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The Consumer Infoum^ion Center is a federal program 
which encouraqes federal agencies tc develop and release consumer 
intormation to t}\*j public. It alsc promotes consumer a'wareness and 
access to information through the "Cowsumer Infer ma ticn Cataio^J" and 
a mail order distribution operation. Through v^^Sifch, the Center* can 
learn. the needs and wants cf consumers, help make (iecisions about 
marketing and distribution of information, and select publications 
for the Catalog. One of thre^* methcds of research is the nationwide 
testing survey, performed quarterly on 2,500 households: it involves 
interviews in-home where -subject s are asked to rest end *o twenty 
consumer titles. Responses are then organized demographically for 
future comparison. The second methcd i$ the catalcg audience survey 
designed to elicit respon^ef to similar items from catalog 
subscribers. Finally, a sampling of 1,000 catalog orders is made for 
indications of preference* Overall results in.dicate a "respondent 
effect" due to enthusiasm on the audience survey and a significantly 
lower interest on the nationwide survey expressed by tllosc over t>5, 
those earning less than $10,000, and those with some high schpol 
education or less. When suggesting topics for puhli^tion, consumers 
consistently select similar items. Research results are used to 
establish consumer informatior priorities, and to target certain 
publication^ to certain demographic qroup»V' to reach lesii 
responsive audiences through radio, television, and the popular 
press- (FP) 



♦ Heproductions suppiifidj^;^ EDFS are the bestj that can* be aaue * 

♦ fromtft^ original docilment/. ♦ 
♦♦♦♦♦♦♦♦♦♦♦^♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦'tiV*+« ♦♦♦♦♦♦♦♦♦♦**♦♦*♦♦♦♦♦♦♦♦♦♦♦♦♦♦*♦♦ ♦♦♦♦♦♦ 



\ 



\ 



rvj 

« — I 

CD 



MtLTIl^p CONSUMERS* INFORMATION NE^EDS: 
PUTTING RE3i.ARCH TO WORK 



By Drew Steketee 
Presented to ACCI by Mary Arsenoff 
/tprll 27, 1979 * 



V- 'i 



ERIC 



U % Ol PAMIMt Nt 0> H% Al TH 
I OUCATtON 4 W^t Af^ 



•1*1-. Iht^-iVfNl »IA'^ Ml I N Wl ♦♦WO 
I M I * Ai t I r A', Ml I I l \ I l> ♦ WOV 
•Ml I'l ♦^•»«»N OW «^W4.AN'. / A Hi »N l>WM.<N 

't N t - I ! Al NA* ONAi tNM I tttU ()l 



•PFRMISSION 10 REPHOOUCl tHIS 
MAIERIAI has BP£N URANltO by 



TOlHt tOUC'.AIIONAL RESOURCES 
INFORMATION CENTER <ERICV' 



V 



MLlMNG- CONSUMLRS* INrORMATION NEEDS: 



\ 



PUTTINflvRESEARCH TO WORK 



[NJIsRESE 



By Drevf^Steketee . 
Presented^ to ACCI by Mary Arsenoff 



ERIC 



The Consumer Information Center is a federal program in 
/ Washingtbn, D.C. that encourages federal agencies to 
develop and relea.se consumer information to the publit. 
It also promotes consumer awareness or arid access to this 
information through the Consuiite r Informat ion Catalog and . 
a mail-order distribution operation in^Pweblo, Colorado. \ 

the Center researches consumer iaformation needs and intef»es.ts. 
(These -data are used to encourage and distribute publications 
consumers really want* ' 

/' ■ 

Reseiirch shows some differences in the infx)ni)atibn^ Interests 
of th« general public versus users of the Consumer I nformati on 
CaUlqa- The Center uses this knowledge^ t(K target ^atalqa 
efforts towards information-seekers, while disseminating ' « 
consumer information to a less responsive audience through . 
radio, television, «nd the (popular press. 

The Consumer Information Center is a federal program established by 
Executive Order in 1970 to coordinate the developmeht, promotion, and 
distribution of consumer publications from the federal government. Its 
two missions are: 1> to encourage federal departments and agencies to 
develop and release relevant and useful consumer information, and 2) to 
increase public awareness of and access to federal consumer information. 

Research plays a vital rdle in guiding these efforts. 

First, it's our policy to encourage agencies to develop information 
consumers need and want — not information the government thinks they 
oCight to get. It's our research challenge to learn these needs and wants. 

Secondly, our research program helps us "make decisions about marketing 
and distribution of consumer information. If information.is to be used 
by the public, we must deliver It to them in a usefuKand accepted form. . 
Through research, we can gauge the different characteristics of our various 
audien<;es and target effective methods of reaching these groups. 

We distribute consumer Information by various methods including radio, TV, 
newspapers, and magazines, both through advertising our consumer booklets 
and by reporting on timely consumer topics. 



But the keystone of our nidrketiny ef forts is the Consumer Information 
Catalog, a, 16- page listing of about 240 federal consumer publ i cations . 
Througti direct ftiail, write-in requests, and display, the Center dis- 
tributes 20 million copies of the Catalog each year. Consumers then 
order the free or low-cost publications they want from the distribution 
center in F'uQblo, Colorado. ^ >^ . 

Thirdly, our research to date centers on selecting publications for the 
CcVnsumer Information Catalog. Because of printirtg costs, the size of 
the Catalog is fixed. So publications compete for listing based on 
popularity. 

In sunuiiary, our research helps us evaluate new topics,, target our mar- 
keting for our audiences, and (;|ecide wKich publications will be listed 
in the 1[^a ta 1 og . Ihese functions are serVed by our nationwide title 
testing survey, .our audience suryey, and\ur "sales" sample. ^ 

NATIONWIDt TITLL ThSTIhfG SURVLY <^ \ 

Lvaluating potential new cpnsumer publication^ begina with .testing 
titles among a represent4t1vji national sample 2500 households* 

Each study is perfonlnejHjuarterly as part of an omnibus survey by a ^ 
contract research i\r\\\ wfrich conducts in-^hoine interviews on everything 
ihm car designs to toothpaste. As one-part^ of this mul ti -faceted inter- 
vi^» the respondent is prf^esented with a listing of 20 consume!" titles 
and descriptions just asAhey would appear in the Consumer Information 
Cdtal(g[(j. The respondent^ marks the list indicating his or her interest in 
ordering each publication if it weVe offered. 

Potential topics for the test are gathered in a number of ways. They may 
be suggested by other government agencies » by our ^taff, by news articles ^ 
or by- consumers themselves- In a^U cjjwut 50 potential test titles are 
narrowed down by conHiiittee tjp 14 actual test items • 

Each .survey also lists six existing publications as controls. These are 
of known popularity and are already listed in the Catalog, Half free 
and half charge titles^ these controls Include one, highly successful and 
two moderately successful publications- each; ^ 

The raw ^X.^ from %his suryey are reti^J^d to us in 60 days. They show 
what percentage of respondents answered In each of four categories: 
"Definitely would order/* "ProB^bly would order/* "Probably wouldn't 
order/* and **Def1n1tely wouldn't order/* Don*t know and not sure re- 
sponses are also tallied. 

•The data represent the opinions of all respondents who we call our 
'total group. Responses are broken down by several demographic factors ^ 
includl^ng age^ education, income, sex, city size, and geographic region. 



The contractor separately tallies the responses of a selected demographic 
group of nationwide respondents that simulates the age, education, and 
income chara/:teri sties of avid .Catalog users who respond to our audience 
survey. This is. our target group. They are betwe^ the ages of 25 an^ 
34, and have one year of college education or more and a household , 
inconje of at le^st $15,000. . 

Ne look at this subgroup to see how responses differ from those of the 
general public. We hypothesized that the target demographic group 
would be mare interested in actively brdering printed co^umer infor- 
mation. Therefore, their responses would be better indi(\itors for 
choosing Catalog publications. ' In fact, they, do respond more strongly 
to consumer titled. But they're somt>limes turned off to titles t^hat 
sound too simplistic or "just conmion sense." 

Let's look at a few examples of how we analyze the results of this 
survey. But first, we must explain a few terms: 
> ♦ 

We measure interest in consumer information by ttie most positive re- 
sponse, "Yes, I defir)itely would order." The percentage of respondents 
^swcring this way is^ the publicdt1on's^"$core." 

Another statKUcal device we use Is dur "index." It's merely a ratio 
of a publication's score to the average score of jall the free or all 
the charge publications tested in that survey.* Any list of 20 topi.cs 
may be more or less popular than another. Or consumers may not feeT Z*^ 
like V^lerlng booklets on a given day. So tHi^ index adjusts for vari- 
ations among surveys and gives us a ^oiimon den^inator by which to 
compTare data among pre\^ous surveys. . 

The Index is simple to understand if you remember that an index of 1.00 
is exactly average. An index of 1.60 means the publication is 1.6 times 
average or 60a- more popular than dverage. An index of .84 is below 
average, about 16'/. less popular. . ' 

A second index is computed comparing all four possible responses, twp 
positive and two negative. This is the ppsi tive-negative index, if 
allows us to examine underlying opinion not reflected in comparing the 
single, most positive responses. For any group of publlcatlions tested, 
there is an average ratio of positive responses to negative responses. 
When the two positive responses occur more often than this average, the 
positive-negative index is higher than 1.00. 'When the negative responses 
exceed. the average, the positive-negative index is lower. 

For exaiQple, a group of tested titles might have an average of 47 posi- 
-•tive "Definitely would" or "Probably would" .responses tO 42 negative 
"Definitely wouldn't" or "Probably wouldn't" replies. The remainder 
would be "Not sure'' or "Don't knoW" responses. • 



- 47 
Thus» the iiverdge ratl^ot pasitive to negative responses would'be 4? 
or 1.11 r If a particular publication has 54 positive to 40 negative 
responses (a ratio 1.35) » its posi-tive-negat-ive index is^ 1.35 or 1.21. 

T.il. 

If a publication's score index were 1.09. the positive-negative index 
of 1.21 shows that overall opinion was comparatively more positive than 
just "De^finitely would order" responses indicate. 

So we have a score, a score index, and a posi tive-nGga'ti ve index. We 
compute these separately fof boUji total and target group responses for 
each publication. 

¥ 

It's important to remember, though, that data far free and charge pub- 
lications are always analyzed separately. 

So ^- here's an example of how we use the data to judge the most prom- 
ising consumer publications for the Catalog. Let's say that Title A 
is a proposed new publication on "Wills. Estates, dnd Taxes" and Tit^e 
B is a' new govt»rnment booklet on Medicare. ^ 
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Score 


Score 


I ndex 


Index 


Index 


A 


19.0 


24 . 3 


1.00 ■ 


1.16 


■' 1.10 


B 


22.0 


19.5 


1 .15 


0.89 


1.38 



Target 
Po^ tlve- 
Ne^ative 
Index 

Titles A 19.0 24.3 1.00 1.16 '1.10 1.4D 

Title B 22.0 19.5 1.15 .0.89 1.38 0.42 

Results show that the target group is more interested iji "definitely" 
ordering Title A than the total group. The target score is higher, the 
target index shows it to be higher above average, and the index of all 
positive and negative responses ifhows even more positive response than 
average. a 

Title B. though, may be a problem for our most avid Catalog audience.^ 
Although the total index is higher than average, the target group isn't 
very interested judging from a lower "Definitely would order" score and 
a below a</erage target index of 0.89. tven the index of target positive 
to negative responses shows stronger overall negative opinion than 
reflected by comparing "definitely would" responses alone. 

tATALOG AUDIENCE SURVEY 

Jo the results of our nationwide survey, we add the opinions of actual 
Catalog users who respond to our,audience survey. We measure thf 
opinion of these audience respondents to contrast with the more average 
group of the national representative sample. We retest our 20 consumer 



titles with these pedpl^ by inserting questionnaires in 1500 out<joing 
orders. Aq average 50a» or 33%. are returned. 

Perhaps because of "i-espondent effect," respondents are of higher inconie 
and education and are niore concentrated in age thah the general public 
or perhaps even Cataloc[ users generally! Also, .audi ente respondents 
are about twice as enthusiastic Kdtheir intentions to order potential 
consumer pubjications. Why? Besides questions of methodology we'll 
cover later, one reason may Jt)e that this group has confidence in us: 

N 

- They've successfully ordered and received publications from the 
Cdtalod at the time they're purveyed; in fact, 75% are repeat 



customers ^ 
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Audience, 


Total 


Target 


Audiehc^ 


Score 


To Target 


1 ndex 


I ndex. 


I ndex_ 


47.9 


(1-97) 


l.t)ft. 


1.24 


.1.13 


28 .2 ' 


(1.47) . 


i.ib 


0.89 f 


0.^7 



- They're satisfied wltj. our service and publ ic^itions (by survey, 
about 95% satisfied). . 

- They're interested in printed consumer information -7 enough 
• to or^r — enough to return the questionnaire. 

So if we add the information from' the audfence survey to our nationwide*, 
title test,- our example might look like this: (Positive-negative 
m«asures eliminated) ^ . , ^ ♦ 

^ Total T^irget 
Score Score 

Ti\1e A 19.0 24.3 

Title B 22.0 19.5 

Title'A's perforiftance continues to improve in the audience score 'by the 
expected factor bf 1.97 compared to target score." In the audience 
index, the slight drop is not sigini f leant. Remember, it's based on 
an average which is affectedly the p6pul«rity of other publications, 
including controls. In the audience survey, the controls are even more 
popular than in the title survey because , our audience has already been 
exposed to them -r and may have already ordered and reyceived them. 

Title B is typical, too, in its ovyn way. It's popuUr with the total 
group but lese popular with the target group jand not at all popular 
with our actual audience respondents. And the ratio of its audience 
to target scores is just 1.47. This is far below our expectation that 
audience respondents will report twice the intentions to "definitely 
order. 

So that's- how we analyze title xtest data- right now. Actually, Title /t 
couVd be any of a number of good to outs tandwg consumer topics we're 
trying ^0 get liito the Consumer Jln^rma^^ Besides "Wills, 



Estates, and Taxes," other topjics of prime Interest Include "Cutting 
Medical Bills" and. "Protecting Yourself from Crime." 

Title B may be a subject of Interest to the total group but of lower 
interest to our avid Catalog users. 

SAMPLING CATALOG ORDERS -^ '* 

How effective Is title testing In predicting popularity of publications 
in the Consjjmer Information Catajo^? The proof of the pudding Is ithe 
"sales" (actuaTTy distrlbutipn) sample measuring actual popularity 
the Catalog.- We randomly sample 1000 Catalog order blanks at our dt5^ 
tri button facility. By tabulating orders, we/determine the percental 
of. consumers ordering each publication. This is our "sales score" 
which we /elate to the total, target, and audience scores that measured 
intentioni to "definitely order." 

The sales performance of a piAli cation determines its chance to be 
listed In the next Issue of th'e Catalog. Any publication that falls 
below a speci-fic level of popularity for two quarters Is s\ibject to 
removal from the Catalog^ ' . * * 

All of our surveys are aimed at predicting thdse consumer publications 

that will be popular, enough to earn a lasting place in the Cat alog . 

We use the techniques outlined below to identify promising publications 

1. Comparison of total nationwide sample opijiion with the 
prefereYices of the select demographic target group 

• * The target group should show highpr interest 

2. Comparison of nationwide opinion with that of audience 
respondents » . ' 

* Audience response should be about twice as strong for 
a free publication, somewhat less for a charge title 

3. Comparison against titles of known C atalog performance 

4 ^ 

* If a publication OMtscorejS a control. It should be 
popular 

4. Ranking of a^ll titles and con^trols ever tested 

* This helps generalize data among various surveys to 
equalize variations in competition 

• DO SURVEYS PREDICT ACTUAL POPULARITY? 

Not quite. For instance, nationwide sample respondents strongly over- 
dbtiroate their Intentions to, order charge publications. And while the 
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audience respondents are. more xeal is lie about charge publications, they're 
unreal istically enthusiastic in t^heir overall ordering intentions.? 

Other factors may bfe^preservt to bias results, including title and 
description changes, time lag between testing and Cdtaipa listing, x 
even new* events and other factors affecting public opinion. And we 
already Know that our target and audience demographics are not exactly 
representative of the totals Catalog audience. But except for ^ip Code 
studies, we cannot survey the audience more closely because of federal 
privacy requirements, 

* *. ' ♦ 

However, we can understand some of the limitations and anomalies Jn 
these studies to better understand the data. For instance, why are 
survey results generally higher, than actual sales percentages? ^ 

Gur* explanation is that surveying rep9rt^4 intentions is a very^^i^recise 
measure of actual behavior. As th^y say ... talk is cheap. _ ^ 

Larger-than-life intentions may also resuy, because an important element 
in real-life ordering is missing in the test procedure. 

/ ^ . • "■ » 

/in actual ordering. Catalog users are t)ermitted only 20 free consumer 
publications per order. On average, they order about- 14.. And thQse 
oruiering charge publ icafi/Ons choose only an average of four, presumably 
because of cost. So for one reason or another, their choices are 
rationed and prioritized. ' - ^ • 

But in the test procedure, the respondent considers eaph publication 
separately without prioritizing selections of competing titles'. There- 
fore, -Definitely would order" intentions are generally higher in the 
test si tuation. . * ' 

Similarly, charge titles test particularly high. Test selections are 
made freely without regard to paying the cost for these choices. This 
behavior- is most apparer^t among the nationwide sample respondents who 
may have never actually ordered from the Consumer Infonnation Cat^^ 
The charge selections of audience respondents are more realistic. 
This may be because the hard decision about buying charge titles is 
still fresh in their minds. 

ARE THLRE ANY AGE, EDUCATION, OR INCOME TRENDS CONCERNING INTEREST IN 
CONSUMER INFORMATION? 

* 

For the purposes of tliis paper, we have generalized opinion on 40 free 
and charge consumer titles tested in two parallel nationwide and 
audience surveys. This represents but a small portion of the data 
available from 13 nationwide and four audience surveys where titles 
were, tested. Since we are just beginning this systematic analysis of 
results, we regard our methodology and results as preliminary. 

We have found that consumer interest in these 40 titles was qliite uni- 
form among most age, education, and income groups. .In comparing 
nationwide and audience opinion, however, we find that significantly 



lower interest was expressed by consumers over 65 years old, Ihose with 
household incomes below $10,000 per year, and those with just some hi^h 
school educJition or less.^ ^ 

The percentage distribution of interest within each demographic charac- 
teristic, shows more clearly the lower interest of the bottom education 
and income gpoups and the oldest age groi^p,' ^ . 

While most age. education, and income subgroups demonstrate roughly 
equal interest between surveys, the three "problem" groups show signif- 
icantly less interest in the nationwide survey. Older citizens over 
65 years old and those, with household incgmes. below $.10,000 are 
respectively 40% and 19% below the average interest of all ages and 
incomes. 

Audience respondents with^some high school education of less actually ^ 
offer 155: more "Definitely would order" responses than average.- perhaps 
an indication of a number of students ordering fiTOm the Catalog- Byt . 
among thfe nationwide sample who may not be Catdlq5[ customers, those 
*-in the lowest education groi^p expressed 23i less^ interest in definitely, ' 
ordering the test publications. . . ' 

What can we conclude about this? We can see that the opinions of our 
audience respondents are not necessarily those of the general public. 
Therefore, we may be justified in tiargeting our marketing, approach by 
providing Catalog, users with ^blications that best'meet their interests. 

* 

We believe that the general public, especially senior citizens and 
those vith lower* i ncomes and education levels, may have a special need 
to be smarter consumers in. these inflationary times. Yet we can be 
less sure that these groups will initiate the transaction through the 
Consumer Information Catalog to receive informational booklets. Jor 
this VeasonV the "Center "den vers "unsol i ci ted" consumer.rjnforma tion 
directly to them through articles in the popular press at»d feature 
stories on radio and TV.** 

On the brighter side, the apparently strong interest of the 25-34 ?ge 
group in our audience survey is reflected in the responses of the 
nationwide sample. This is our top market - young people who may lack 
the experience of age but who face tough choices in home buying, child 
rearing, and financial management. They also have tl^e educational 
background and financial resources to be our best customers for printed 
consumer infomation. And for the time being, the "baby boom" bulge 
in this age group assures us a large, enthusiastic audience for consumer 
information. 

WHAT TOPICS DO CONSUMER SUGGEST THtMSELVtS? 

We test consumer titles which may be developed by federal agenciesr in 
Washington, But we also ask audience respondents what other titles 



.^they'd like. And from' time to time we find a winner such as "Keeping 
Your Family's Health Records." 

What are th/ir greatest interests? Constftners are fairly consistent 
. tin *sugges ting five or six areas most^ frequently including, heal th , 
exercise, food., diet, child rearing and children's books, and energy 
Perhaps because we're a government operation, they request publications 
explaining government operations and services, taxes, the law,, and 
^ current legislation. Predictably* , public opinioh is fickle - the top 
' area of interest changes with current events and the seasons. 

-'Other areas of consistent but less pressing interest include: consumer 
.protection,, careers and jobi, senior citizen's subjects, home improve- 
ment and do-it-yourself ^projects, crafts, education, gardening, car 
care, small appliances, credit, and subjec^ts for the handicapped. 

As if that weren't enough, consumers offered an additional 119 single 
suggestions in a recent survey. This demonstrates both the wide 
diversity of consumer interests antj the broad opportunities and 
challenge we all have. to meet consumers' information needs. 

PUTTING THIS RESLARCH TO WORK ' 

Our judgements concerning the resuljts of title testing help determine 
our consume-r information objectives with nearly 30 federal agencies in . 
^ Washington. 

Our agency liaison staff uses research results tV convince federal 
authors and policymakers to publish needed consumer information. More- 
over, survey results can suggest that Authors should target publications 
to certain demographic groups or adjust the reading level Of a prospec- 
tive publication. 

Overall, this information helps agency officials establish their consumer 
information priorities and gives them ammunition in pursuing these 
priorities with agency administrators. In the often subjective field 
of anticipating the public interest, opinions backed by survey results 
can sometimes make the difference. 
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^TABLET: Key Comparispns between Demographic Characteristics of Audience 
Respondents and US Population 



Audience 

US Population 
(1976) 



AGH 



EDUCATION 



25- 45- High School College Grad 
34 64 or less or more 



30^0 33% 



34-r. 
7'?<y 

/ t_ o 



sn 
m 



HOUSEHOLD INCOME 

$10K . $20K ' 
or le^s or more 



14% 

39% 



45% 

25% 



TABLf 2: Aver^ige "Definitely Would Order" Scores for Recent Surveys ^nd 
Typical Averages for Actual Orders • > ■ 



24 Free Titles 
16 Charge Titles 



NATIONWIDE 
SAMPLE 

11.74% 

9.75% 



AUDIENCE 
RESPONDENTS 

*30.57;; 

20.99% 



SALES SAMPLE 
(Typical) 

10.0% ' 

1 .7% 



^ABLE 3*: Average Percentage of "Definitely Would Order" Responses by 

Demographic Characteristics for Nationwide and Audience Surveys 



AGE 



EDUCATION 



HOUSEHOLD INCOME 



25-35-45-55- Some HS Some Coll . $10- $15- 

-24 34 44 54 64 ^ .iii- "^T^ Coll. Grad+ -$1QK $15K i20K $20K+ 



Audience 27 29 25 24 26 23 31 
nationwide 12 13 11 Ip 10 6 8 



24 
11 



26 
12 



27 
11 



29 



26 .24 27 



11 12 



11 



11 



^. tABLE 4: Percentage Distribution of "Definitely Would Order" Responses for 
Both Surveys Across Age, Education, and Income Characteristics 



AGE 



-24 



25^34 



35-44 



45-54 



55-64 



65+ 



Audience - 17.5 
Nationwide 19.1 



18.7 
20.7 



16.3 
17.9 



15.3 
06..2 



16.7 
15.8 



15.2 ^ 
9.9 



EDUCATION 



Some HS 
or less 



HS Grad 



Some 
College 



College Grad 
or more 



Audience 
Nationwide 



28.9 
19.2 



22.5 



26.1 



23.6 



27.3 



24.7 
27.1 



HOUSEHOLD 
INCOME 



Audience 
Nationwide 



-SIOK 



27.4 
20.4 



$10-1 5K* 



$15-2QK 



24.5 
25.4 



22.8 
27.8 



$20K+ 



25.1 
26.3 



